Emergence of hierarchical networks and polysynchronous behaviour in simple 

adaptive systems 
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We describe the dynamics of a simple adaptive network. The network architecture evolves to a 
number of disconnected components on which the dynamics is characterized by the possibility of 
differently synchronized nodes within the same network (polysynchronous states). These systems 
may have implications for the evolutionary emergence of polysynchrony and hierarchical networks 
in physical or biological systems modeled by adaptive networks. 
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Graphs or networks are used to describe the evolu- 
tion and interaction of coupled systems. Each node is 
assumed to have an underlying dynamics which can be 
affected by 'neighbouring' nodes. This influence is rep- 
resented by a directed edge, or arrow, indicating input 
from one node to another in the direction of the arrow. 
This can be complicated by allowing the neighbours of 
a node to vary with time as a function of the state of 
the nodes, giving rise to adaptive networks Q3I2]- These 
models have been applied to a broad range of problems 
including the connectivity of the internet, the social in- 
teractions in a community and motifs in systems biology, 
see PHI] for further details and examples. 

The dynamics of these systems can be rich, both in 
terms of the temporal dynamics at the nodes and the 
emergence of topological structure in the networks. For 
example, the dynamics can synchronize, so all nodes be- 
have asymptotically in the same way [5j . Polysynchrony 
describes a more subtle form of synchronization [rjlfTU] 
where groups of nodes can be synchronized and, unlike 
cluster synchronization, synchronized nodes need not be 
connected to each other. 

The aim of this note is to show that complicated 
polysynchronous dynamics can emerge in adaptive net- 
works using a simple homophilic principle to determine 
the evolution of the links of the network. This is based 
on the idea that nodes 'like' being connected to simi- 
lar nodes, a common assumption in many socially moti- 
vated networks and a basic principle in neural network 
dynamics. In other words we consider a collection of iden- 
tical individuals operating under the same homophilic 
rules, and show that the system evolves to a finite num- 
ber of connected components, each of which can display 
polysynchronous states. All the examples we have looked 
at have a further interesting property: the final states 
have graphs which have a hierarchical structure, with a 
group of strongly connected components at the bottom, 
and then the remaining nodes being arranged above these 



(taking information from them, but not giving informa- 
tion) in levels reflecting the number of directed links 
needed to get to the node from one of the bottom nodes 
or 'roots'. (Note that we say a set of nodes is strongly 
connected if there is a path in the graph following the di- 
rected edges or arrows between any two nodes, and con- 
nected if there is a path between any two nodes following 
edges, so the path can use an edge in the opposite di- 
rection to the arrow.) This suggests that polysynchrony 
and hierarchy are natural states that can emerge from 
simple undifferentiated networks over time. We will dis- 
cuss further implications of this towards the end of the 
article. 




FIG. 1. Example of a polysynchrony pattern (N — 10, e = 
0.85). In this case the node dynamics have been attracted to 
two different fixed points. Nodes filled with the same pattern 
are synchronized including the isolated pair {6,9}. Arrows 
have an associated weight and equation (p| tells us that, for 
each node, the weights of all incoming arrows sum up to m = 
N — 1. Since a node always get its inputs from only one 
synchrony class, we have avoided labelling the weights for the 
sake of clarity. 



Before describing our model in full detail it is worth 
looking at a couple of examples to illustrate the results. 
The first (Fig. [I]) shows the final state of our system be- 
low with ten nodes. The final graph has broken into 
two subsystems; one containing two nodes and the other 
eight nodes. The eight node subsystem has two basic 
strongly connected sets, {1,2,8} and {7,10}, and these 



influence but are not influenced by nodes 4 and 5, which 
in turn influences node 3. There are two polysynchrony 
classes: the dynamics of nodes {2, 4, 5, 9, 10} is identical 
as is that of the remaining nodes. At first sight this ap- 
pears remarkable as the nodes in the isolated pair {6, 9} 
are also part of the same polysynchrony classes. We ex- 
plain this below. In this case the dynamics is trivial: two 
fixed points, one for each polysynchrony class, but more 
complicated behaviour is possible as shown in Fig. [2j 



FIG. 2. Example of a polysynchrony pattern (JV = 10, e = 
0.8). The node dynamics are chaotic in this case. Nodes filled 
with the same pattern are synchronized. 

The final state in Fig. [2] is a chain based on two inter- 
acting nodes at the root with polysynchrony classes that 
oscillate up the chain. The dynamics of each polysyn- 
chrony class is chaotic, but each element of the same 
class is fully synchronized. 

To summarize from these two observations: the dy- 
namics breaks up into a small number of disconnected 
sets, and within each of these sets the dynamics may be 
either simple (a fixed point in the first example) or more 
complicated (chaotic in the second example), and in fact 
we will show that different behaviours across polysyn- 
chrony classes in the same connected component are also 
possible. Contrary to full synchronization or cluster syn- 
chronization, the synchronized nodes have no direct links 
connecting them. Moreover the final graphs have a hi- 
erarchical structure, lending themselves to interpretation 
as motifs as they allow a well-defined sense of input and 
output nodes. 

The model consists of a directed network of N nodes. 
The dynamics of the ith (i = 1, . . . , JV) node are given 
by 
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where we choose / to be the fully-chaotic logistic map 
f(x) = 4x(l — x) and A n is the adjacency matrix of the 
network at time step n, so A% = k if there are k con- 
nections (directed edges) from j to i, with the direction 
indicated by the arrow in the accompanying figures. Each 
node is assigned a fixed number m of incoming links so 
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and we choose m = N — 1 throughout this paper. These 
links can be rewired at each iteration following an algo- 
rithm that will be described below. 

At each iteration the ith node is influenced by the dy- 
namics of those nodes to which it is connected by an 



incoming arrow. We will call these nodes the neighbours 
of node i. Due to the condition imposed by d2b, a node 
can have at most m neighbours. 

We describe now the rewiring mechanism. At each 
iteration n we compute the distance matrix D% 
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and calculate from it the mean distance of a node to all 
its neighbours 
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where a % n is the unweighted number of neighbours of node 
i at time step n, i.e. the sum over j of sign(A^). 

For the rewiring we apply a homophilic principle: 
nodes prefer to be connected to nodes being in a sim- 
ilar state. We identify the bad neighbours j € B l n of each 
node i at iteration n with the following criterion 
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so a neighbour j is considered bad if its distance D% 
to the node is larger than the average distance of the 
neighbourhood {D) l n . The good neighbours of node i are 
then given by 
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so i $_ Q l n which means that a node never becomes linked 
to itself. Once the good and bad neighbours have been 
identified node i will break the links coming from B\ and 
randomly rewire them to nodes in Q l n . Let b l n be the 
number of bad neighbours 
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Now choose b % n elements of Q l n at random and suppose 
that r l * is the number of times node k is chosen. The 
adjacency matrix at the next time step is 
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In all the cases described here the initial connectivity 
is the symmetric all-to-all connectivity where each node 
in the network is connected to all the possible m — N — 1 
neighbours and A" = 0. 

The first main observation is that, at least for sys- 
tems of moderate size, the rewiring dynamics always set- 
tles down to a frozen state after a finite amount of time. 
This is possible due to the criterion used to perform the 
rewiring of the links at each iteration. If at time step 
n, a node i has all its incoming links coming from the 
same node or from a synchronized set of neighbours, all 



elements in the distance matrix D^ will have the same 
value (1$ = ( D )n for a11 3 such that A % ^ 0) resulting 
in an empty set of bad nodes and hence 'locking' node i 
to its neighbourhood for the next time step. However, we 
should notice the locking process is not purely probabilis- 
tic because the interactions between the nodes correlate 
their dynamics thus affecting the locking probabilities. 

The second and most important observation is that, 
as Fig. [3] shows, the dynamics of the nodes once the net- 
work has frozen has a high probability of being polysyn- 
chronous for a wide range of coupling strengths, namely 
0.75 < e < 1 and also 0.12 < e < 0.2. There are other 
possible dynamics for this adaptive network model de- 
pending on the value of the coupling strength including 
uncorrelated dynamics (no two nodes are synchronized), 
full synchronization (all the nodes in the network syn- 
chronize) and cluster or partial synchronization, but in 
the regions of parameter space that we have identified, 
polysynchronous and hierarchical states appear most fre- 
quently. 

As studied in [6] the network needs to satisfy some 
symmetry requirements in order to achieve robust 
polysynchrony. The structure of polysynchronous net- 
works requires a balanced equivalence relation to be es- 
tablished on the nodes, so the nodes can be separated into 
equivalence classes of nodes with equivalent inputs. For 
example, in Fig. [I] none of the nodes in the same syn- 
chrony class have links connecting them to each other, 
but receive all their m inputs from nodes in the other 
synchrony class. In principle, a more general input equiv- 
alence could be established in which nodes in a certain 
synchrony class receive inputs from various synchrony 
classes (including inputs from their own synchrony class) 
[TT] . However, using arguments similar to those for the 
locking mechanism we can show that this is not possi- 
ble in our model due to the homophilic rewiring criterion 
chosen: if a node receives inputs from two different syn- 
chrony classes a certain time step n then typically the 
distance from these sets will be different and all the links 
from one class will be rewired at the next time step |12j . 
We have taken advantage of this property of the model to 
assess the polysynchronous character of the final network 
by comparing the final difference (8% = \x l n — x 3 n \) and 
adjacency matrices. If all the non-diagonal elements in 
the difference matrix (which reflect synchrony between 
two nodes) correspond to non-connected nodes (reflected 
by elements in the adjacency matrix) then our network 
is polysynchronous. 

A further characteristic of the networks showing 
polysynchrony in our model is that their structure is usu- 
ally strongly hierarchical. If we define the set of nodes in 
strongly connected components to be the 'roots' of the 
network (for instance, nodes 2 and 8 are the root of the 
network in Fig. [2| then the 'level' of a node is the min- 
imum (directed) path length from the root to the node, 
and the 'height' of a node is the average distance over all 




FIG. 3. Probability of polysynchrony as a function of the 
coupling strength e. N = 10, 100 initial conditions have been 
evaluated for each value of e. Polysynchrony has been identi- 
fied as explained in the text. 



possible directed paths from the root to the node. These 
concepts are inspired by the definitions of 'trophic level' 
and 'trophic height' introduced for the study of food webs 
[13] , and our choice of the root ensures that the level and 
height are well-defined [12] ■ We say that a network is 
strongly hierarchical if level and height coincide for all 
the nodes in the network. One can see this definition ap- 
plies to the networks in Fig. [I] and [2] Another example of 
strongly hierarchical polysynchronous network is shown 
in Fig. HI where the root is composed of two strongly con- 
nected pairs. This example has the additional interest 
that different synchrony classes inside the same cluster 
show different dynamical behaviour. While the root pairs 
{5, 10} and {4, 6} follow a period-2 cycle, the rest of the 
nodes in the network show period-4 dynamics. Moreover, 
it is interesting to note that nodes in classes {4,5} and 
{1,3,8,9} all receive the same input (from class {6,10}) 
but show different dynamics. This illustrates that hav- 
ing equivalent inputs is only a necessary but not suffi- 
cient condition to be in the same synchrony class [14j . 
Finally, note that since an element of a given polysyn- 
chrony class receives its inputs from a given other syn- 
chrony class, the equations determining the dynamics of 
each polysynchrony node are the same. This implies that 
the after identifying all nodes in the same polysynchrony 
class the dynamics is based on a very small number of 
possibilities: we conjecture that these quotient systems 
are based on rings (sometimes with additional spokes as 
in Fig. |4| . This explains the synchrony across the uncon- 
nected components of Fig. [I] - the quotient dynamical 
systems are identical - a connected pair - and the dy- 
namics has no phase information as it is just made up of 
fixed points. If the dynamics is more complicated then 
phase information can be different in different connected 
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FIG. 4. Example of a polysynchronous pattern (N = 10, 
e = 0.14). In this case there are 4 different synchrony 
classes showing 2 different dynamical behaviours: {4, 5} and 
{6, 10} are synchronized in a period-2 cycle while {2}, {7} and 
{1, 3, 8, 9} show period-4 dynamics. 



components with the same quotient system, see 
more details. 
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The emergence of polysynchrony in networks of un- 
differentiated nodes operating with a simple homophilic 
dynamic evolution suggests natural mechanisms for the 
emergence of polysynchrony in nature. Combining this 
with an additional slow timescale dynamics to describe 
the evolution of differentiated polysynchronous states 
over time would provide a way of locking in the polysyn- 
chronous pattern making it more stable to perturbation, 
or alternatively the evolutionary dynamics could select 
the appropriate polysynchronous patterns if only some 
subset of the possible patterns is advantageous to the 
system. We have reported results with relatively low 
numbers of nodes. As the number of nodes increases 
transient times increase significantly, and so evolution- 
ary time scales could become comparable to the time of 
approach to the frozen state, and this may provide an- 
other way whereby evolution and differentiation or spe- 
ciation can interact, although numerical simulation then 
becomes harder. The hierarchical nature of the asymp- 
totic networks imply that they could operate as motifs, 
with a well defined input and output level, so in this case 
our model may provide a mechanism for functional dif- 
ferentiation. Models similar to the one proposed here are 
used to describe metapopulations [TS] so there may also 
be applications in this area. 
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